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ABSTRACT 


The  filter  design  problem  is  considered  as  an  optimization  problem, 
An  iterative  search  technique  is  employed  to  adjust  the  variable  net- 
work element  values  to  approximate  some  desired  network  response,  with 
a  minimum  of  error.   Explicit  constraints  are  employed  to  ensure 
physical  rea lizability .   The  design  process  uses  a  combination  of  a 
modified  version  of  Calahan's  network  analysis  program  with  a  direct 
search  method  of  minimization  developed  by  Hooke  and  Jeeves.   The 
result  is  a  procedure  which  utilizes  the  circuit  designer's  experience 
and  knowledge  to  set  up  the  problem  but  relieves  him  of  the  tedious 
labor  now  performed  by  the  high-speed  digital  computer. 
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I.   INTRODUCTION 

A.   COMPUTER-AIDED  NETWORK  DESIGN 

Mathematical    programming   techniques    have    found  wide    use    in   operations 
research,    economics,    and    other   related    fields.      However,    it   has    only  been 
in   recent    years    that    such   techniques    have    gained   acceptance   as    tools    for 
the   design   and   evaluation   of  electronic   circuits.      The   development   of 
several  general   network-analysis    programs   has   made   computer-aided   net- 
work design  quite   attractive.      What    is    computer-aided    network  design? 
The    circuit    operation   is    first   analyzed   by  means    of  a   computer.      It    is 
then  modified   and   analyzed   again  until   the   desired   result    is   achieved—a 
trial-and-error    procedure.      Naturally   the   more   experienced    the   engineer, 
the    fewer    the    trials    before   a    satisfactory  design   is    realized. 

The   engineer    today  has   a   variety   of  analysis    programs   which   may 
suit   his    needs    in   the   design   of   networks.      Some    of   the   more   well-known 
ones   are:      NET-1,    ECAP,    SCEPTRE,    NASAP,    CIRCUS,    LISA,    PANE,    CALAHAN, 
and   CORNAP.      Programs    such   as    these   have    offered   great   assistance    to 
the   engineer    in   the   analysis   and   design   of   networks.      Although   the 
obvious   advantages    in   saving   of   time   and    tedious    labor   are   quite 
apparent,    there   are   certain   features    that   would   be   desirable   and 
perhaps    possible    in    future    programs    of    the    type   mentioned.      Some    of 
these    features   may   include: 

1.  A  graphical   output    on   remote    terminals   which  will   allow   the 
engineer    to  check  his    results   and   make    on   the   spot    changes    as    necessary. 

2.  Automatic   means    for    improving   the    circuit   design;    i.e.,    some 
optimization    technique    to   obtain   "best"   element   values. 


As  valuable  an  aid  as  the  computer  is,  a  significant  part  of  the 
design  procedure  will  still  require  the  engineering  judgement  of  the 
designer.   The  cost  for  relieving  the  engineer  of  all  the  tedious  calcu- 
lations required  for  analysis  is  not  an  inexpensive  one.   The  engineer 
must  use  his  knowledge  to  specify  the  network  topology,  the  response 
desired,  constraints  on  element  values,  error  criteria,  reasonable 
initial  element  values,  and  other  information  which  only  he  can  provide. 

B.   USE  OF  OPTIMIZATION  TECHNIQUES  IN  COMPUTER-AIDED  NETWORK  DESIGN 

The  network  designer  is  basically  confronted  with  the  problem  of 
designing  a  circuit  to  meet  some  prescribed  performance  requirements. 
The  design  may  be  accomplished  in  one  of  many  ways.   If  the  requirements 
are  such  that  an  existing  synthesis  technique  will  provide  the  answer, 
the  problem  is  essentially  solved,  and  a  satisfactory  solution  is  obtained. 
In  some  cases  a  perfectly  good  design  may  be  achieved  in  the  laboratory 
by  physically  wiring  the  circuit  on  the  "bread-board"  and  experimentally 
determining  the  "best"  element  values  for  the  design. 

There  are  classical  synthesis  techniques  which  provide  a  step-by- 
step  design  procedure,  resulting  in  the  circuit  configuration  and 
element  values  [1].   However,  there  are  some  design  problems  which  may 
not  be  amenable  to  solution  by  any  of  the  known  synthesis  techniques. 
The  designer  may  be  given  a  requirement  in  the  form  of  a  table  of  values 
or  a  graph  of  the  response  desired.   Such  a  requirement  cannot  be  satis- 
fied by  the  classical  synthesis  techniques.   If  the  circuit  contains  a 
large  number  of  variable  elements,  design  by  a  trial-and-error  process 
in  the  laboratory  is  also  highly  unfeasible.   Again,  as  with  the  analysis, 
the  high-speed  digital  computer  has  offered  an  alternative  approach  to 


the  problem.   We  can  now  use  some  optimization  technique  to  find  element 
values  in  a  given  design  configuration  which  yield  a  solution  nearest 
to  the  prescribed  performance  requirement.   The  optimization  technique 
iteratively  adjusts  the  element  values  until  the  requirement  is  approxi- 
mated as  closely  as  possible. 

Although  synthesis  techniques  are  available  for  the  design  of 
standard  high-  and  low-pass  filters,  they  do  not  take  into  account  any 
constraints  on  the  network  configuration  or  element  values.   Problems 
of  this  nature  would  certainly  be  amenable  to  solution  by  an  optimi- 
zation technique.   Networks  whose  transfer  functions  are  extremely 
complex  comprise  another  class  of  problems  which  could  be  solved  by 
optimization.   Optimization  may  also  be  used  to  obtain  models  for  active 
devices.   An  optimization  scheme  could  well  be  used  in  the  design  of 
matched  filters.   There  are  countless  other  examples,  but  suffice  it  to 
say  that  a  combination  of  a  good  network  analysis  program  and  an 
efficient  optimization  program  is  certainly  an  excellent  application 
of  computer-aided  network  design. 

C,   OPTIMIZATION  TECHNIQUES 

In  any  optimization  procedure  two  requirements  must  be  satisfied. 
First,  there  must  be  some  means  to  determine  the  behavior  or  performance 
of  the  system  for  any  set  of  parameter  values.   Second,  a  performance 
measure  must  be  selected  which  is  a  numerical  measure  of  the  behavior 
of  the  system.   The  optimization  is  basically  a  matter  of  minimizing 
the  performance  measure,  which  is  a  function  of  the  parameters.   If  we 
think  of  this  in  geometric  terms,  the  points  in  the  parameter  space 
represent  different  circuit  element  values  and  any  change  in  the  element 


value  will  result  in  movement  to  another  point  in  the  space.   The  per- 
formance measure  is  defined  on  this  parameter  space  and  requires  an 
additional  dimension  if  it  is  to  be  represented  geometrically. 

Minimization  techniques  generally  do  not  yield  the  global  minimum. 
What  is  found  is  a  local  minimum,  but  by  changing  the  starting  values 
of  the  parameters,  it  can  be  determined  whether  the  local  minimum  is 
also  the  global  minimum.   If  the  minimization  procedure  converges  to 
different  values  of  the  performance  measure,  the  smallest  value  of  the 
performance  measure  is  then  selected  as  the  global  minimum.   The  dif- 
ferent minimization  techniques  may  be  classified  by  the  method  which 
is  utilized  to  find  a  local  minimum.   They  may  be  generally  classified 
in  the  three  following  categories : 

1.  Direct  search  methods:  those  which  do  not  compute  the  partial 
derivatives  of  the  performance  measure  with  respect  to  the  parameters, 
but  use  only  the  value  of  the  performance  measure. 

2.  Gradient  methods:   those  which  require  the  calculation  of  the 
first  partial  derivatives  of  the  performance  measure  with  respect  to 
the  parameters. 

3.  Second-Order  methods:   those  requiring  higher-order  partial 
derivatives . 

No  attempt  will  be  made  here  to  discuss  the  various  methods  under 
each  category.   An  excellent  discussion  of  the  methods  can  be  found  in 
Ref.  [2]. 

D.   THE  GENERAL  NATURE  OF  THE  PROBLEM 

Earlier  it  was  stated  that  for  problems  which  cannot  be  solved  by 
existing  synthesis  techniques  or  by  experimenting  with  the  circuit,  an 
optimization  technique  may  be  feasible  as  an  alternative  solution. 
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Problems  which  are  amenable  to  solution  by  optimization  will  generally 
be  stated  as  follows :   "Given  a  particular  network  with  a  fixed  number 
of  variable  elements,  adjust  these  elements  until  the  response  of  the 
network  minimizes  some  preassigned  criterion".   The  key  words  in  this 
general  statement  are  "particular  network  with  a  fixed  number  of  vari- 
able elements".   For  a  particular  desired  response  there  may  be  several 
network  configurations  which  will  yield  comparable  results.   The  job  of 
the  designer  then  is  to  choose  among  the  configurations  he  tries,  and 
to  select  the  best  design  which  satisfies  the  requirements.   One  of  the 
desirable  features  the  engineer  would  like  in  future  programs  for  com- 
puter-aided design  is  the  ability  of  the  program  to  also  produce  the 
network  configuration  as  well  as  the  element  values  for  the  optimal 
network  for  a  given  response.   With  the  existing  programs  the  engineer 
starts  with  a  particular  network  configuration  and  a  fixed  number  of 
variable  elements  are  adjusted  until  the  performance  meets  some  pre- 
assigned criterion. 

Now  that  the  type  of  design  problem  is  defined,  the  important 
features  of  the  optimization  process  may  be  studied.   Figure  1-1 
gives  the  essential  elements  which  should  be  a  part  of  the  optimization 
technique  for  the  circuit  design  problems. 

The  choice  of  the  network  configuration  and  the  initial  element 
values  is  the  task  of  the  engineer  before  the  actual  optimization 
process  begins.   The  features  to  be  discussed  now  are  the  evaluation 
of  the  response,  the  performance  measure  and  the  decision-making 
process . 

The  first  thing  the  optimization  program  must  be  capable  of  doing 
is  to  evaluate  the  response  from  a  given  set  of  element  values.   This 
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Adjust 
Element  Values 


NO 


Compute  Network 
Response 


Fig.  1-1  The  Optimization  Process 

must  be  done  each  time  the  element  values  are  adjusted.   The  analysis 
programs  mentioned  above  all  have  this  capability. 

Once  the  response  has  been  evaluated,  it  must  be  compared  with  the 
desired  response.   The  measure  of  behavior  is  the  performance  measure. 
It  is  impossible  to  choose  a  single  criterion  and  call  it  the  universal 
performance  measure.   The  nature  of  the  problem  may  determine  what  per- 
formance measure  is  to  be  used.   The  experienced  circuit  designer  will 
generally  have  in  mind  what  performance  measure  is  best  for  a  given 
situation.   The  performance  measure  chosen  must  remain  the  same  throughout 
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the  design  procedure.   Some  problems  will  dictate  what  performance 

measure  is  to  be  used,  but  in  many  cases  the  choice  is  purely  subjective 

[3]. 

There  are  several  typical  forms  of  the  performance  measure  the 

designer  may  use  in  the  optimization  process.   The  simplest  form  would 

be 

N 
J(p)  =  £   |RA  (f.)  -  R^  (f.)| 
i=l 

where  J(p)  is  the  performance  measure,  a  function  of  the  parameter 

values  £,  the  terms  R   (f.)  and  R^  (f.)  represent  the  actual  and  desired 

frequency  responses,  respectively,  and  N  is  the  total  number  of  points. 

This  form  of  the  performance  measure  indicates  that  only  the  magnitude 

of  the  difference  is  of  interest,  positive  and  negative  deviations 

having  equal  weight.   Another  performance  measure  is 


N 

J(P)  =  2 
i=l 


.RA  (fi>  "  "D  (fi'J 


where  n  is  some  even  integer.   When  the  difference  between  the  actual 
and  desired  responses  are  small,  say  less  than  1.0,  then  the  value  of 
this  performance  measure  will  decrease  with  increasing  values  of  the 
exponent,  n.   These  are  just  two  examples  of  what  may  be  used  for 
performance  measures.   By  defining  the  performance  measure  in  some  way 
such  as  mentioned  above,  the  optimization  procedure  is  one  in  which  a 
search  is  conducted  to  find  the  minimum  of  the  performance  measure. 

The  search  for  this  minimum  generally  results  in  finding  a  local 
minimum  as  mentioned  above.   Only  if  it  is  known  that  the  function  is 
unimodal  will  the  local  minimum  be  the  global  minimum.   Otherwise,  it 
is  necessary  to  conduct  a  systematic  search  of  the  entire  parameter 
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space  in  order  to  locate  the  global  minimum.   For  problems  that  have 
more  than  three  or  four  variable  parameters  this  may  not  be  feasible. 
However,  if  the  search  is  started  with  new  initial  values  of  the 
elements,  and  the  function  value  converges  to  the  same  value,  then  one 
can  be  relatively  certain  that  a  global  minimum  has  been  located.   By 
finding  a  minimum,  whether  it  be  local  or  global,  a  perfectly  acceptable 
solution  may  be  obtained.   In  the  final  analysis,  it  is  the  engineer's 
decision  whether  the  final  network  configuration  behaves  in  a  satis- 
factory manner  or  whether  further  investigation  is  necessary  to  locate 
a  "better"  minimum. 

This  final  aspect,  the  decision  of  the  engineer,  is  perhaps  the  most 
critical  item  in  the  optimization.   He  must  weigh  the  cost  of  further 
exploration  to  find  a  smaller  minimum  against  the  solution  he  already 
has.   A  great  deal  depends  on  what  the  circuit  requirements  are.   The 
tolerances  on  the  element  values  may  be  such  that  the  procedure  may 
have  to  be  repeated  again  and  again.   On  the  other  hand,  there  may  be 
very  weak  restrictions  on  the  element  values  so  long  as  the  response 
matches  the  desired  response  within  say  0.1%.   The  computer  relieves 
the  engineer  of  the  tedious  work  involved  in  any  optimization  procedure, 
but  he  is  still  responsible  for  making  the  knowledgable  decisions  to 
use  the  computer  most  advantageously. 
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II.   THE  OPTIMIZATION  PROGRAM 

A.   ANALYSIS  PROGRAM 

As  mentioned  in  Chapter  I,  the  optimization  procedures  will 
include  an  analysis  program  and  a  minimization  program.   Among  the 
various  programs  available,  the  CAIAHAN  and  ECAP  programs  were  con- 
sidered as  likely  choices.   Both  programs  were  subjects  of  study  in 
a  course  in  computer-aided  design,  taught  by  Professor  S.  G.  Chan, 
offered  at  the  Naval  Postgraduate  School.   The  CAIAHAN  program  was  the 
final  choice  since  it  provides  for  a  graphical  output  of  the  frequency 
response,  an  output  not  available  with  ECAP.   Presumably  the  engineer 
who  is  designing  by  optimization  will  either  choose  a  program  which  he 
has  used  successfully,  or  he  will  write  a  program  to  suit  his  needs. 

1 .   A  Linear  Network  Analysis  Program 

The  CALAHAN  program  is  a  general-purpose  program  designed  for 
the  analysis  of  linear  electrical  networks  [4],   Input  data  to  the 
program  consists  of  the  number  of  nodes  in  the  circuit,  the  number  of 
passive  elements,  the  number  of  active  elements,  the  input  and  output 
node  numbers,  and  the  type  of  output  desired.   A  list  of  element  values 
must  be  provided  as  well  as  a  range  of  values  of  frequency  (time)  over 
which  the  frequency  (transient)  response  is  to  be  calculated.   Outputs 
from  the  program  are  the  coefficients  of  the  specified  network  function, 
the  poles  and  zeros,  frequency  and/or  transient  responses.   The  program 
is  designed  so  that  the  user  need  only  provide  the  required  data  cards, 
to  obtain  the  desired  output. 
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2 .   Modification  of  CAIAHAN  for  Use  in  the  Optimization  Program 

In  order  to  incorporate  CAIAHAN  into  the  optimization  program, 
it  was  necessary  to  make  some  modifications  to  the  original  CALAHAN 
program.   Before  this  was  done,  the  original  version  was  run  a  con- 
siderable number  of  times  to  yield  frequency  responses  of  circuits 
for  which  the  actual  responses  were  known.   From  the  closed-form 
expression  of  the  voltage  transfer  function  of  the  Butterworth  filter 
[5],  the  theoretical  frequency  responses  were  obtained  for  various 
orders  of  this  type  of  filter.   Using  values  of  the  normalized 
Butterworth  filters  [6],  frequency  responses  were  calculated  by 
CALAHAN  for  different  orders  of  the  filter.   The  responses  calcu- 
lated by  CAIAHAN  were  almost  exactly  the  same  as  the  theoretical 
responses.   The  procedure  was  also  repeated  with  the  Chebyshev  filter 
and  similarly  good  results  were  obtained. 

Since  the  goal  of  the  optimization  is  to  determine  a  set  of 
element  values  for  a  particular  network  configuration  whose  frequency 
response  is  to  match  a  given  response  as  closely  as  possible,  only  the 
portion  of  CALAHAN  that  calculates  the  frequency  response  is  needed. 
The  main  program  from  the  original  CAIAHAN  was  reduced  until  only  the 
portions  involving  the  frequency  response  remained.   Several  subroutines 
that  are  not  essential  to  the  calculation  of  the  frequency  response 
were  removed. 

B.   THE  MINIMIZATION  PROGRAM 

The  minimization  program  used  in  conjunction  with  CALAHAN  to  form 
the  optimization  program  is  a  direct  search  technique  [7].   This 
category  of  minimization  techniques  requires  only  the  calculation  of 
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the  value  of  the  performance  measure,  the  calculation  of  derivatives 
not  being  a  requirement.   A  gradient  technique  used  in  the  design  of 
filters  by  optimization  is  the  subject  of  the  Naval  Postgraduate  School 
thesis  written  by  Major  Charles  A.  Henry,  USMC .   Results  obtained  using 
the  two  methods  are  discussed  and  compared  in  Chapter  IV. 
1.   Direct  Search 

Direct  search  may  be  basically  described  as  a  sequential 
examination  of  trial  solutions  which  involves  the  comparison  of  the 
trial  solution  with  the  "best"  solution  obtained  up  to  that  time  and 
a  method  for  determining  what  the  next  trial  solution  will  be  [7]. 
Among  the  various  types  of  problems  which  can  be  solved  by  direct 
search  are  solution  of  system  of  equations,  curve-fitting  problems, 
solution  of  integral  equations,  and  minimizing  (or  maximizing) 
functions  with  or  without  constraints  on  the  variables.   The  application 
of  direct  search  methods  to  the  solution  of  problems  of  the  types 
mentioned  above  is  basically  the  same  regardless  of  the  type  of  problem. 

A  space  of  P  points,  representing  the  solution  space,  must  be 
defined.   There  must  be  some  means  to  determine  that  one  point  is 
"better"  than  another.   Presumably  there  is  a  "best"  solution  P*  in 
the  solution  space.   Direct  search  is  then  accomplished  in  the  following 
manner:   A  point  B, ,  designated  the  first  base  point,  is  arbitrarily 
selected  in  the  space.   A  second  point,  P_ ,  is  then  selected  and  com- 
pared with  B,.   If  P„  is  "better"  than  B1  then  P~  becomes  B- ,  the 
second  base  point.   However  if  P9  is  not  "better"  than  B1 ,  then  B. 
remains  the  base  point.   The  process  continues  with  each  new  point 
selected  and  compared  with  the  current  base  point.   The  technique  for 
selecting  new  trial  points  is  determined  by  various  conditions  which 
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arise  as  a  function  of  results  of  trials  made.   The  technique  to  be 
used  in  the  minimization  program  is  pattern  search. 
2 .   The  Specific  Technique  —  Pattern  Search 

Pattern  search  is  a  direct  search  technique  for  finding  the 

T 
minimum  of  a  function  F(p)of  the  variables  p  =  (p  ,  p    p    ...,p  )  . 

The  argument  p  is  varied  until  a  minimum  value  of  F(p)  is  obtained. 

The  successive  values  of  p  represent  points  in  an  N-dimensional  space. 

The  operation  of  the  pattern-search  routine  will  now  be 
described.   First,  a  few  definitions  will  be  of  aid  in  the  ensuing 
discussion.   The  procedure  of  going  from  one  point  to  another  point 
is  termed  a  move .   If  the  value  of  F(p)  decreases,  then  the  move  is  a 
success  ;  if  the  function  F(p)  does  not  decrease,  then  the  move  is  a 
failure .   Pattern  search  makes  two  types  of  moves.   The  explore  move 
is  to  acquire  knowledge  about  the  behavior  of  the  function  F(p).   The 
second  type  of  move  is  the  pattern  move  which  utilizes  the  information 
gained  from  the  explore  moves  to  accomplish  the  actual  minimization  of 
the  function  by  moving  in  the  direction  of  an  established  pattern.   The 
point  from  which  a  pattern  move  is  made  is  known  as  a  base  point . 
Basically  the  pattern-search  procedure  is  movement  from  base  point  to 
base  point. 

The  explore  move  provides  the  information  which  indicates  a 
probable  direction  for  a  successful  move.   A  pattern  is  thus  estab- 
lished.  The  pattern  move  from  a  given  base  point  duplicates  the 
combined  moves  from  a  previous  base  point  if  the  direction  of  the 
pattern  is  unchanged.   This  process  continues  as  long  as  the  moves 
are  successful,  the  step  lengths  increasing  in  magnitude.   The  result 
of  each  pattern  move  then  is  either  a  success  or  a  failure.   If  the 
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pattern  move  is  a  success,  then  a  series  of  explore  moves  is  carried  out 
to  see  if  the  result  can  be  further  improved. 

Each  explore  move  is  carried  out  in  the  following  manner:   a 
single  coordinate  of  the  point  is  varied  by  either  increasing  or 
decreasing  the  coordinate  by  some  fixed  amount  and  seeing  if  the  move 
is  a  success.   If  a  success  occurs,  the  new  coordinate  value  is  used; 
otherwise  the  old  coordinate  is  retained.   For  each  coordinate,  these 
explore  moves  are  made  until  the  final  point,  as  a  result  of  all  the 
explore  moves,  becomes  the  new  base  point. 

If,  on  the  other  hand,  the  pattern  move  is  a  failure,  the  search 
continues  by  retreating  to  the  base  point  and  starting  over  again  with 
new  explore  moves  until  a  new  pattern  is  established. 

The  pattern-search  technique  can  be  better  understood  with  the 
aid  of  a  simple  example.   Figure  II-l  serves  as  an  illustration  of  what 
has  been  discussed  in  the  previous  paragraphs.   A  two-dimensional  para- 
meter space  is  shown  with  equal-cost  contours  represented  by  F..  ,  F„ , 

T 
...,  F_ ;  where  F,  >  F    .   The  argument  of  the  function  F  is  p  =  (p,,p0)  , 
o         k     k+1  ~     L      Z 

The  point  B1  is  selected  as  the  first  base  point  and  explore  moves  are 
conducted  from  this  point.   First  the  p,  coordinate  is  stepped  in  its 
positive  and  negative  directions;  a  success  is  achieved  when  the  step 
is  negative.   Next  the  p„  coordinate  is  tested  and  it  is  determined 
that  a  positive  step  yields  a  success.   The  explore  move  produces  a 
new  base  point  B„ .   The  most  probable  direction  of  a  success  is  in  the 


direction  of  the  line  segment  B,B  ;  therefore,  the  pattern  is  estab- 
lished and  the  pattern  move  results  in  TP, ,  a  temporary  point.   Each 
pattern  move  is  followed  by  a  series  of  explore  moves.   If  the  result 
of  the  explore  moves  is  a  success ,  then  the  pattern  move  is  termed  a 
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p2 


Scale    =  S 


Fig.    II-l      Contour   Map    for    Pattern   Search 
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success.   The  point  resulting  from  the  successful  explore  moves  becomes 

the  new  base  point.   If,  however,  the  explore  moves  are  failures,  the 

function  value  at  the  temporary  point  is  calculated  and  if  this  value 

is  greater  than  the  function  value  at  the  previous  base  point,  the  old 

base  point  becomes  the  new  base  point  and  explore  moves  are  tried  again. 

At  TP  explore  trials  are  made  and  a  successful  move  is  made  to  B_  , 

which  becomes  the  new  base  point.   This  indicates  that  the  pattern  move 

to  TP,  was  a  success.   By  the  same  line  of  reasoning,  the  pattern  move 

to  TP-  is  a  success.   The  pattern  move  to  TP„  is  a  failure  since  all 

explore  moves  from  this  point  are  failures  and  the  value  of  the  function 

at  TP„  is  greater  than  the  value  at  B. ;  therefore  B.  becomes  Br,  the  new 
3  4  4  5 

base  point,  and  the  explore  moves  are  tried  again.   The  region  within 

the  F0  contour  is  enlarged  by  a  factor  of  five  and  shown  in  Fig.  II-2. 
o 

The  point  B,  is  a  successful  explore  but  it  should  be  noted  that  there 
is  no  change  in  the  p_  coordinate  from  B<-.  A  change  in  the  p9  coordi- 
nate would  yield  a  failure.   The  pattern  move  to  TP,  is  a  failure,  so 

B,  now  becomes  B..  and  explore  moves  are  made.   Perturbations  of  both 
6  7       r 

p1  and  p9  in  the  original  step  size  do  not  produce  any  successful 
explore  moves.   It  is,  therefore,  necessary  to  reduce  the  step  size 
by  some  fixed  amount.   The  step  reduction  factor  in  this  case  is  0.2, 
which  means  that  the  original  step  size  has  now  been  reduced  by  a 
factor  of  five.   Once  again  explore  trials  are  made,  now  with  the  new 
step  size,  and  a  success  is  achieved  at  BQ.   The  pattern  move  to  TP,. 

o  J 

is   a    failure,    so   B,.   becomes   B    .      A   successful  explore   move    is   achieved 
89  F 

at   B,„   but    the    pattern  move    to  TP,    is    a    failure   and   B,„   becomes   Bnn. 
10  d  10  11 

This    process    of   reducing   the    step   size   and   then  making   the    pattern   moves 
continues    until    the   difference   between   two  consecutive   steps    is    less    than 
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i  p. 


p      Scale  =  5S 


Fig.  II-2   Enlargement  of  F   Contour 
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some  prescribed  amount.   If  this  criterion  is  a  very  small  number  then 
the  step  size  will  be  sufficiently  small  to  ensure  that  the  minimum  has 
been  closely  approximated.   Care  must  be  taken  in  the  choice  of  both  the 
step  size  and  the  step  reduction  factor.   Too  large  a  reduction  factor 
will  result  in  a  slowdown  of  the  search  procedure.   If  an  initial  step 
size  is  too  large,  the  minimum  may  be  missed  altogether. 

The  direct  search  procedure  described  above  is  termed  pattern 
search  since  the  minimization  is  basically  performed  by  the  pattern 
moves.   Although  the  explore  moves  provide  some  reduction,  their  main 
purpose  is  to  provide  information  for  the  improvement  of  the  pattern 
move.   The  pattern-search  program  used  in  the  optimization  program  is  a 
program  written  by  R.  Hilleary  ,  with  some  modifications  to  include  con- 
straints on  the  independent  variables. 

C.   THE  OPTIMIZATION  PROGRAM- -A  COMBINATION 

In  sections  A  and  B  the  individual  programs  in  the  optimization 
program  were  discussed  in  some  detail.   A  brief  description  was  given 
of  the  modifications  to  CAIAHAN  to  accommodate  the  particular  problems 
to  be  considered.   How  are  CAIAHAN  and  DIRECT  together  to  be  imple- 
mented into  one  program  to  be  used  in  the  design  of  networks  by  optimi- 
zation?  The  answer  to  this  question  is  the  subject  of  this  section. 

The  basic  type  of  filter  design  problem  which  will  be  solved  by  the 
optimization  program  is  one  in  which  a  particular  frequency  response  is 
given  and  the  objective  is  to  design  a  filter  which  approximates  the 
response  as  closely  as  possible.   In  the  next  chapter  the  exact  problem 
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problem  formulation  and  specific  example  problems  will  be  discussed  in 
detail,  but  the  above  problem  description  is  adequate  for  a  general 
discussion  of  the  optimization  program.   After  the  particular  circuit 
has  been  selected,  a  choice  of  initial  element  values  must  be  made,  the 
engineer's  knowledge  and  experience  playing  a  vital  role  in  the  choice. 
Other  information  which  must  be  supplied  to  the  program  includes  the 
following:   the  number  of  frequency  points  to  be  matched,  the  values  of 
the  desired  frequency  response  at  the  points  to  be  matched,  the  explicit 
constraints  on  the  element  values,  the  step  size,  the  step  reduction 
factor,  and  the  termination  criterion  for  the  minimization. 

The  initial  element  values  serve  as  coordinates  of  the  first  base 
point  for  the  pattern  search  routine,  called  DIRECT.   An  external 
function  subprogram  then  calculates  the  value  of  the  function  to  be 
minimized  by  DIRECT.   The  exact  form  of  this  function  may  differ  for 
different  problems,  but  in  all  cases  it  is  a  comparison  between  the 
actual  frequency  response  and  the  desired  response.   This  calculation 
is  performed  as  part  of  the  function  subprogram  utilizing  the  modified 
version  of  CALAHAN.   Once  the  minimum  has  been  determined,  the  element 
values  producing  the  minimum  are  supplied  to  the  analysis  program  and 
the  actual  frequency  response  is  calculated.   This  process  may  be 
repeated  until  the  overall  design  satisfies  all  of  the  requirements. 
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III.   IMPLEMENTATION  OF  THE  OPTIMIZATION  PROGRAM 

The  use  of  the  optimization  program  is  dictated  by  the  requirements 
for  the  design.   An  optimization  technique  should  be  used  only  when 
classical  synthesis  methods  and  experimental  methods  are  either  impos- 
sible or  unfeasible.   The  purpose  of  this  chapter  is  to  discuss  the  use 
of  the  optimization  program  in  circuit  design.   The  first  section  of  the 
chapter  is  a  general  discussion  of  the  features  of  the  program.   In  the 
concluding  section  several  examples  are  given  to  illustrate  the  use  of 
the  program. 

A.   PROGRAM  FEATURES 

1.  The  Input  Data 

For  input  data,  the  optimization  program  requires  a  topological 
description  of  the  network,  a  list  of  element  values,  a  range  of 
frequencies  over  which  the  desired  and  actual  responses  are  to  be 
matched,  a  description  of  the  desired  response,  the  number  of  varying 
and  non-varying  elements,  and  a  list  of  the  constraints  on  the  varying 
elements.   The  following  information  required  by  DIRECT  must  also  be 
included  in  the  input  data:   the  step  size,  the  step  reduction  factor, 
the  termination  criterion,  and  the  maximum  allowable  number  of  evalu- 
ations.  Figure  III-l is  a  flow  chart  showing  the  sequence  and  coding  of 
the  input  data  cards. 

2.  The  Output 

The  output  from  the  optimization  program  consists  of  two  parts. 
The  first  part  is  a  result  of  the  minimization  and  includes  the  value 
of  the  function  at  convergence,  and  the  optimum  values  of  the  variable 
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Oard  No.  1  Titlt 
Use  all  80  columns  as 
required  for  the  title 


Oard  No.  2  Circuit  Data 
-No.  of  Passive  (R,L,0)  Elements 
No.  of  active  Elements 
No.  of  Nodes 


i 


0©l./l23*5678S|0135i 
Pos.  Input  NodeJ 
Neg.  Input  Node 
Pos.  Output  lode 
Neg.  Output  Node 
FORJUT  (7(12,  U)) 


Oard  No.  3,4 ■  Passive  Elements 

Node  No.  of  Branch 

P  Type  of  Element  (R,L,C) 


I 


Ool.fi 2345678901 234567830 

Element  Value-* 
P0RMaT(I2,U,I2,1X,a1,1X,?1O.O) 


© 


Fig.    III-l      Coding   Flow  Chart    for    Optimization    Program 


26 


Next  Card(s)   Ac  tire  Bl«ntnt» 
-  Node  lo.  of  Active  llement 

r-Node  No.  of  Controlling  Branch 


Col/ 1 2345678901 23^5676 >01 234367890 


2^, 


Trans conductance  G  or 
Mutual  Inductance  M 

FORMAT  UU2,U),A1,U,F10.0) 


G 


.Value  of  0  or  M 


Next  2  Cards  frequency  Response  Data 
Scale  (1 -Linear, 2-Logarithnic) 


r  Total  No.  Points  or 

' ' 


Points/Decade 


Col./  12345 
F0RMAT(I1,1X,I3) 

r~Low  Frequency 
rHlgh  Frequency 


Col . /1 2345678901 234567890 

FORMAT  1 2F1 0.0) 


Next  Cardie)   Desired  Frequency  Response 
FORMAT (F1 5. 7) 


Fig.    III-l    (continued) 
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® 


Next  Card 
No.  of  Constant  Element! 

p  Mo.  of  Variable  Elements 


Col.^  1234567890 
FORMAT  (215) 


Next  Card   Parameters  for  Pattern  Search 

r  Step  Site    r  •*•?  Seduction  factor 
i  ' 


Col .  f  1 2345678901 2345678901 234567890 1 2345678901 2345  67890 

1 1 


Termination  Criterion 


Maximum  Ho.  of  Evaluations 


F0aHlT(3P15.7,I5) 


Next  Card(e)   Element  Constraints 

Upper  Bound 

Lower  Bound 


Col.fi 2345678901 2345678901 234567890 
P0RMaT(2»15.7) 


Fig.  III-l  (continued) 
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elements.   The  second  part  of  the  output  is  a  result  of  the  analysis 
program.   With  the  optimum  element  values  calculated  by  DIRECT,  the 
frequency  response  is  calculated.   The  output  is  in  tabular  form  as  well 
as  in  a  graphical  form.   The  circuit  designer  merely  compares  the  values 
of  the  calculated  response  with  those  of  the  desired  response.   If  the 
design  requirements  are  satisfied,  the  element  values  calculated  in  the 
first  part  of  the  output  are  the  element  values  of  the  design. 
3 .   Accuracy  of  the  Optimization  Program 

In  all  examples  used  in  testing  the  program,  the  performance 
measure  to  be  minimized  was  of  the  form, 


N 

J(p)  =  2 

i=l 


RA  <£i>  "  \    (fi> 


where  J(p)  is  a  function  of  the  network  elements  p.   R   (f.)  is  the 
actual  frequency  response  at  the  i   comparison  point  and  R   (f.)  is 
the  desired  response  at  the  same  point  of  comparison.   N  is  the  total 
number  of  frequency  points  to  be  compared  and  n  is  some  even  integer. 
Theoretically,  the  minimum  of  this  performance  measure  is  zero  if  a 
perfect  match  of  frequency  responses  is  achieved.   In  practice,  however, 
a  zero  output  is  rarely,  if  ever,  achieved.   The  measure  of  accuracy  is 
determined  by  the  function  value  at  exit  from  DIRECT;  the  smaller  the 
function  value,  the  closer  the  actual  response  approaches  the  desired 
response . 

The  accuracy  of  the  output  is  basically  dependent  upon  the 
choice  of  the  termination  criterion  for  DIRECT.   The  pattern  search 
ends  when  the  difference  between  consecutive  step  sizes  falls  below 
this  pre-selected  termination  criterion.   A  small  criterion  will  result 
in  a  small  function  value,  consequently  a  closer  approximation  to  the 
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desired   response.      The    program  allows    the    user   to   specify   the    termination 
criterion  as    part    of    the   input.      Table    III-l   shows   a   comparison   of 
execution   times,    and    function  values ,    for   a   normalized    fourth-order 
Butterworth    filter,   as   a    function   of   the   step   size,    the    step   reduction 
factor,    and    the    termination   criterion.      The    performance   measure    used  was 
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J(p)    =     S 
i=l 


LRA  <£i>   -  %  (fl>J 


-4 
The  function  values  for  a  termination  criterion  of  10   differ  by  a 

-  ft 
factor  of  100  from  those  for  a  termination  criterion  of  10   ;  whereas 

-  ft 
the  difference  between  function  values  for  termination  criteria  10   and 

-9 
10   is  insignificant.   In  this  case  there  is  no  particular  advantage  in 

-  ft 
the  choice  of  a  termination  criterion  less  than  10   ,  since  the  function 

values  only  change  slightly  but  the  execution  times  are  longer.   A  com- 
parison between  the  desired  response,  for  the  frequency  range  specified, 
and  the  largest  and  smallest  function  values  is  given  in  Table  III-2. 
4 .   Execution  Time 

The  execution  time  for  the  program  is  dependent  on  several 
factors  which  will  be  discussed  in  this  section.   The  initial  choice 
of  element  values  will  certainly  affect  the  execution  time;  if  the 
initial  guess  is  a  poor  choice  the  program  may  take  an  inordinate  amount 
of  time  if  it  converges  at  all  to  a  minimum.   Convergence  to  a  minimum 
also  may  be  quite  slow  for  circuits  with  a  large  number  of  elements. 
The  only  solution  to  this  problem  is  to  choose  a  simpler  circuit  con- 
figuration which  may  yield  a  response  within  acceptable  tolerances.   In 
the  pattern  search,  the  execution  time  is  a  function  of  the  termination 
criterion.   The  choice  of  the  termination  criterion  is  a  compromise 
between  speed  and  accuracy;  one  is  sacrificed  for  the  other.   If  more 
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TABLE   III-l 

Step 

Step   Red. 

Termination 

Execution 

Function      _ 
Value   x    10 

Trial 

Size 

Factor 

Criterion 

Time    (Sec) 

A 

0.05 

0.25 

ID"4 

50.38 

203.67 

B 

0.05 

0.25 

ID"6 

68.30 

0.31191 

C 

0.05 

0.25 

io"9 

78.01 

0.23612 

D 

0.05 

0.125 

ID"4 

54.93 

105.01 

E 

0.05 

0.125 

io"6 

70.18 

0.11424 

F 

0.05 

0.125 

io"9 

71.77 

0.11424 

G 

0.1 

0.25 

io"4 

46.37 

386.91 

H 

0.1 

0.25 

io"6 

70.90 

0.55285 

I 

0.1 

0.25 

io"9 

78.07 

0.54994 

J 

0.1 

0.125 

io"4 

49.09 

60.625 

K 

0.1 

0.125 

io"6 

57.52 

7.753 

L 

0.1 

0.125 

io"9 

63.03 

7.723 

M 

0.5 

0.25 

io"4 

68.27 

16.730 

N 

0.5 

0.25 

io"6 

87.31 

0.14581 

0 

0.5 

0.25 

io"9 

90.89 

0.14581 

P 

0.5 

0.125 

io"4 

85.22 

284.77 

Q 

0.5 

0.125 

io"6 

104.78 

0.12187 

R 

0.5 

0.125 

io"9 

110.14 

0.12187 
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TABLE   XIX-2 


Desired 
Response 

•  0.1042320 

■  0.2204427 

•  0.4314420 

•  0.7850979 

■  1.3305276 

•  2.1019602 

■  3.1032674 

•  4.3047100 

•  5.6547211 

■  7.0972899 

■  8.5844102 
•10.0806382 
•11.5623696 
•13.0151248 
•14.4307494 
•15.8052081 
■17.1370394 
•18.4263366 
•19.6740983 
•20.8818219 
•22.0512536 


Trial  G 
Response 

-  0.1032002 

-  0.2196893 

-  0.4310329 

-  0.7850114 

-  1.3306713 

-  2.1021585 

-  3.1033316 

-  4.3045549 

-  5.6543064 

-  7.0966568 

-  8.5836172 
-10.0797758 
-11.5614929 
-13.0142879 
-14.4300060 
-15.8045635 
-17.1365509 
-18.4259949 
-19.6738892 
-20.8817902 
-22.0513916 


Trial  F 
Res  ponse 

-  0.1042283 

-  0.2204416 

-  0.4314427 

-  0.7851012 

-  1.3305340 

-  2.1019697 

-  3.1032581 

-  4.3047056 

-  5.6547127 

-  7.0972862 

-  8.5844040 
-10.0806456 
-11.5623751 
-13.0151329 
-14.4307604 
-15.8052015 
-17.1370392 
-18.4263458 
-19.6740875 
-20.8818054 
-22.0512390 
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accurate    results   are   required    then   the   execution   time    is    necessarily 
longer.      Table    III-l   shows    the   effects    of  different    step   reduction 
factors   and   termination  criteria.      A   further   comparison   of  execution 
time   as   a    function   of   the    number   of   points    compared    is   made    for   the 
normalized    fourth-order  Butterworth    filter.      The    results    of   this   com- 
parison  are    shown   in  Table   III-3. 

TABLE   III-3 


Function  Value 
0.8699953   x   10"8 
0.4037205  x   lo"7 
0.3040103  x   10"8 
0.1142364  x   10"8 


B.      DESIGN  EXAMPLES 

To   illustrate    the    use    of   the    optimization    program,    several   examples 
of    filter   design  will  be   discussed    in   this    section.      In  all   of   the 
examples,    the   desired    frequency   response    is    in   the    form   of  a    table    of 
values.      These  values   are    to  be   matched   as    closely   as    possible   by   the 
circuit   configuration   selected.      In   general,    design  specifications   are 
not    quite   as    stringent   as    this.      A  more    likely   specification  would   be 
to   design  a   maximally   flat    filter    in  a    pass    band  whose   cut-off 
frequencies   are   at    f..    and    f~    and  with   a   dropoff   of  a   specified    number 
of  db   per   octave;    however,    to   illustrate    the    capability   of    the    program, 
point-by-point   comparisons   will   be   made. 


No. 

Points 
50 

Execution  Time 

(Sec) 

147.06 

40 

112.77 

30 

83.93 

20 

71.77 
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Example    1 

Problem:      Find   the    optimum  element   values    for   the    filter   con- 
figuration shown   in  Fig.    III-2 ,   whose    frequency  response    from  0.15Hz 
to   0.24Hz   most   closely  approximates    the    5      -order  Butterworth   response 
over   the    same   range    of   frequencies. 


Fig.    III-2      Circuit    for   Example    1 


Constraints    on  element   values 


0.5  <   LL  <    1.75 
1.0  <  C-  <  2.5 

1.0  <   L3  <    1.6     R  =   1.0 
0.4  <  C4  <   1.0 
0.1  <   L5  <  0.75 


Solution : 
Trial  1  Initial  guess:   L  =1.0,   C  =2.0,   L  =1.5,   C,=.8,    L5=-5 

At  exit  from  program:    L  =1.29,  C  =2  .  12  ,  1^=1.19,  C  =.888,  L  =.161 

—  f> 
Function  value  =  .2435  x  10 


Trial  2  Initial  guess:   L  =1.6,  C  =2.0,  L  =1.5,   C  =.8,    L  =.5 
At  exit  from  program:    L  =1.7,  C  =1.5,  L  =1.51,  C,  =  .875,  L,.=  .372 
Function  value  =  .6473  x  10 


Trial  3  Initial  guess:   L  =1.6,   C  =2.0,  L  =1.5,   C,=.9,    L  =.5 

At  exit  from  program:    L  =1.54,  C2=1.7,  L„=1.38,  C4=.895,  L5=.307 

-13 
Function  value  =  .5150  x  10 


Trial  4  Initial  guess:   L  =1.6,  C  =2.0,   L =1.5,   C,=.9,    L  =.3 
At  exit  from  program:   L1=1.43,  C2=1.87,  L=1.29,  C-=.903,  L5=.253 
Function  value  =  .1384  x  10 
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Trial    5    Initial   guess:      L  =1.6,      C   =1.8,    L  =1.5,      C   =   9,         Lr=-^ 

At   exit    from   program:         L  =1.54,    C   =1.7,    L  =1.38,    C,=.895,    L  =307 

-13 
Function  value    =    .429   x    10 


The    optimum  element   values   are    those   values    calculated    in   trials    3   and 
5.      Comparison   of   the    trial    frequency  responses   with    the   Butterworth 
response    is    shown   in  Table    III-4. 

Discussion--In   this    problem  only   ten   points   were   compared,    if  more 
accurate    results   are   desired   more    points    should   be    compared.      The   element 
values    for    trials    3   and    5   are   very   close    to   the   values    for    the    fifth 
order   normalized   Butterworth    filter. 
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Example  2 

Problem:   Design  a  filter  which  approximates  the  straight-line 
characteristic  shown  in  Fig.  III-4. 

Solution:   Select  the  circuit  configuration  by  determining  the  slope 
of  the  straight  line  after  cutoff.   The  slope  is  approximately  24db  per 
octave.   Each  6db/octave  represents  one  order  of  a  low-pass  filter; 
therefore  the  circuit  to  be  used  for  the  design  is  a  fourth-order  low- 
pass  filter  as  shown  in  Fig.  III-3. 


Fig.  III-3   Circuit  for  Example  2 


Results  : 
The  first  initial  guess:    L  =2 . 0 ,   C  =2.0,   L  =2.0,   C ,=2.0 


At  exit  from  program: 


L  =1.44,  C  =1.62,  L  =1.10,  C  =0.379 
1        2        3        4 


The  second  initial  guess:   L  =1.5,   C  =1.5,   L=1.0,   C,=0.5 
At  exit  from  program:      L  =1.44,  C2=1.63,  L  =1.10,  C,=0.381 

A  plot  of  the  actual  and  desired  responses  is  shown  in  Fig.  III-4, 
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Fig.    III-4      Desired    and  Actual   Responses    for   Example    2 
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Example    3 

Problem:      Design  a    filter    that   has   a   Gaussian  distribution   response 
in    the    frequency    range    from   0Hz    to   4Hz  . 

Solution:      The    first    step   in   the    solution   is    to   change    the   Gaussian 
response    from  a   voltage    ratio   to  db    for   use    in   the    optimization   program. 
Table    III-5   contains    the   values    for   a   21-point   comparison.      The    response 
is    plotted    in  Fig.    III-5. 

The    first    trial  design  was    a   ninth-order    low-pass    filter.      The 
resulting   response    is    plotted    in  Fig.    III-5   showing   rather   marked 
deviations    from   the   desired   response.      At    the    lower    frequencies    the 
deviations   are   much   greater. 

The   second   trial   design  was   a   modified    fifth-order    low-pass 
filter.      The   response    is    plotted    in  Fig.    III-5.      There    is   a   slight 
improvement    in   the   approximation;    however    the   deviations   at   some    points 
are   quite    large. 

Discussion:   In  this  problem,  only  low-pass  filter  configurations 
were  considered.   Both  design  responses  deviated  considerably  from  the 
desired  responses.   This  points  out  a  limitation  of  the  optimization 
program.   The  success  of  the  optimization  technique  is  dependent  upon 
the  circuit  configuration  selected.   In  this  example,  presumably  there 
is  a  better  circuit  configuration  which  would  approximate  the  desired 
response  with  less  deviation. 
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TABLE   III-5 

Desired 

Design    1 

Design  2 

Freq. 

Gain 
0. 

Gain 
0. 

Gain 

0. 

0. 

0.2 

-   0.174 

0.389 

-    1.296 

0.4 

-   0.693 

1.827 

-   2.886 

0.6 

-    1.563 

1.172 

-   3.000 

0.8 

-   2.779 

-   3.918 

-    1.969 

1.0 

-   4.341 

-   7.501 

-   3.687 

1.2 

-   6.253 

-   8.378 

-   8.179 

1.4 

-   8.512 

-   6.581 

-11.557 

1.6 

-11.119 

-10.663 

-13.150 

1.8 

-14.067 

-17.770 

-12.961 

2.0 

-17.368 

-22.048 

-14.552 

2.2    . 

-21.012 

-23.421 

-21.813 

2.4 

-25.005 

-18.813 

-28.598 

2.6 

-29.345 

-22.974 

-34.113 

2.8 

-34.067 

-36.294 

-38.755 

3.0 

-39.172 

-44.084 

-42.794 

3.2 

-44.437 

-50.013 

-46.388 

3.4 

-50.458 

-54.899 

-49.640 

3.6 

-56.478 

-59.072 

-52.618 

3.8 

-61.938 

-62.697 

-55.371 

4.0 

-70.458 

-65.865 

-57.933 
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Fig.    III-5      Comparison    of  Two   Designs   with    the 
Gaussian   Response 
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Example    4 

Problem:      Design  a   simple   bandpass    filter   to  match   the   desired 
frequency   response   of  Table    III-6. 

Solution:      A  simple   third-order    low-pass    filter    is    transformed   into 
a  bandpass    filter   by   frequency   transformation.      The   resultant   circuit    is 
shown   in  Fig.    III-6. 


t 


e  . 

1 


A^ 
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°3  L4 
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Fig.    III-6     Bandpass   Filter  Design 


Results  : 
The    initial  guess:      L=0.5,        C=1.2,        C=1.2,      L.-0.5,        L=0.75,     C,=0.75 
Exit    from  program:      L=0.278,   C2=0.968,   C3=1.07,    L4=0.231,    L  =0.512,   C,=0.5 


Results   are    tabulated    in  Table    III-6. 
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TABLE    III-6 


Freq. 

0.12 

0.14 

0.16 

0.18 

0.20 

0.22 

0.24 

0.26 

0.28 

0.30 

0.32 

0.34 

0.36 

0.38 

0.40 

0.42 

0.44 

0.46 

0.48 

0.50 

0.52 

0.54 

0.65 


Desired 
Gain 

-10.6043911 

-  7.8007050 

-  6.5953960 

-  6.1859341 

-  6.0634375 

-  6.0301752 

-  6.0222807 

-  6.0207853 

-  6.0205956 

-  6.0205870 

-  6.0205832 

-  6.0205908 

-  6.0206118 

-  6.0207939 

-  6.0214853 

-  6.0233574 

-  6.0275412 

-  6.0356464 

-  6.0498857 

-  6.0731249 

-  6.1088524 

-  6.1611710 

-  6.2347078 


Actual 
Gain 

-10.6046772 

-  7.8000298 

-  6.5954628 

-  6.1866503 

-  6.0643120 

-  6.0309124 

-  6.0227900 

-  6.0211134 

-  6.0207987 

-  6.0207443 

-  6.0207691 

-  6.0208607 

-  6.0210257 

-  6.0213528 

-  6.0221939 

-  6.0242023 

-  6.0284853 

-  6.0366526 

-  6.0509090 

-  6.0740948 

-  6.1096964 

-  6.1618414 

-  6.2351713 
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TABLE    III-6    (continued) 


0.58 
0.60 
0.62 
0.64 
0.66 
0.68 
0.70 
0.72 
0.74 
0.76 
0.78 
0.80 
0.82 


Desired 

Actual 

Gain 

Gain 

-  6.3344698 

-  6.3346691 

-  6.4655190 

-  6.4654360 

-  6.6326761 

-  6.6323280 

-  6.8401451 

-  6.8395615 

-  7.0910606 

-  7.0902948 

-  7.3872252 

-  7.3863807 

-  7.7288332 

-  7.7280092 

-  8.1145258 

-  8.1138344 

-  8.5414162 

-  8.5409737 

-  9.0054874 

-  9.0054045 

-  9.5018768 

-  9.5022497 

-10.0253372 

-10.0262442 

-10.5705452 

-10.5720444 
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Example    5 

Problem:      Determine    the   element   values    of  a    fourth-order    low-pass 
filter  whose    frequency   response   approximates    the    response    of  a    fourth- 
order  Butterworth    filter   using: 

(a)  ideal   elements 

(b)  inductances   with    nominal   resistance    of   0.01    ohms 

(c)  inductances   with   nominal   resistance    of   0.5   ohms 
Solution:      The   circuit    selected    is    the    same   as    in  Fig.    III-3    but 

there   are    series    resistors   with    the    inductances   when  non-ideal   elements 
are   considered.      The    initial   guess    for   the   elements    is    the    same    for   all 
three    situations.      All   parameters    for  DIRECT  remain   the   same.      The 
frequency   range    is    from  0.1  Hz    to   0.3   Hz,    comparing   21    points.      The 
results   are    shown   in  Table    III-7.      Figure    III-7    is   a   comparison   of   the 
frequency   responses    for   circuits   with    ideal   and   non-ideal   elements. 

Discussion:      For   nominal   resistances    of   0.01   ohms    the   element   values 
did    not    change   much    from   the   values    of   the    ideal   elements    since    the 
resistances   are    so   small.      When   the   resistance    is    of   the    same    order    of 
magnitude   as    the    inductance    then   the    final   element   values    differ   con- 
siderably  from   the    ideal   element   values.      Also,   with   non-ideal   elements 
the    frequency   response   as    shown   in  Fig.    III-7    is   attenuated   at    the    low- 
frequency  end. 
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o      Frequency   Response    for   Circuit 
with    Ideal   Elements 

+      Frequency   Response    for   Circuit 
with    Non-ideal   Elements 


Fig.    III-7      Response    of    Ideal   and   Non-ideal   Circuits 


TABLE    III-7 


Ideal   Element   Values 


Non- ideal   Element   Values 


R      -   0 
s 

R      -   0.01 
s 

R 
s 

=  0.5 

L:   =    1.53 

L-    -    1.51 

Ll 

-   1.11 

C2    =    1.58 

C2    =»    1.59 

C2 

-   1.31 

L3   =    1.08 

L3    «    1.09 

L3 

=    1.53 

C.    =   0.383 

4 

C.    -  0.386 
4 

C4 

-   0.215 
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IV.   SUMMARY  AND  CONCLUSIONS 

The  subject  of  computer-aided  design  by  optimization  techniques, 
although  only  one  facet  of  computer-aided  design,  is  in  itself  quite 
a  diverse  field.   There  is  a  large  variety  of  optimization  methods 
which  can  be  effectively  employed  in  network  design.   The  main  reason 
for  using  an  optimization  technique  instead  of  a  classical  synthesis 
technique  in  circuit  design  is  that  classical  techniques  cannot  satisfy 
all  possible  design  specifications.   A  specification  such  as  matching 
the  response  of  a  circuit  to  some  desired  response  given  by  a  table  of 
values  or  a  graph  cannot  be  realized  by  classical  techniques.   Con- 
straints on  circuit  element  values  generally  cannot  be  accommodated 
by  classical  methods.   Such  design  specifications  which  cannot  be 
realized  by  classical  methods  can  often  be  satisfied  by  optimization 
techniques . 

A .   SUMMARY 

Chapter  I  is  an  introductory  chapter  presenting  a  general  discussion 
of  computer-aided  design  and  application  of  optimization  techniques  in 
computer-aided  design.   The  three  basic  categories  of  optimization 
techniques  are  described  and  the  general  nature  of  the  problem  is 
presented . 

In  Chapter  II  the  optimization  program  is  described.   The  optimi- 
zation program  used  is  a  combination  of  the  linear  network  analysis 
program  by  Calahan  and  the  pattern-search  technique  for  minimization 
of  a  function  of  several  variables.   Modifications  to  the  original 
analysis  program  were  made  in  order  to  incorporate  it  into  the 
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optimization  program,   Basically  this  was  a  matter  of  reducing  the 
size  of  CALAHAN,  since  only  the  portion  pertaining  to  frequency 
response  was  required.   The  specific  method  of  pattern  search,  DIRECT, 
in  conjunction  with  the  modified  version  of  CALAHAN  constitute  the 
optimization  program. 

The  specific  details  regarding  the  implementation  of  the  optimi- 
zation program  are  included  in  Chapter  III.   Instructions  for  coding 
of  input  data  cards  are  shown  as  a  coding  flowchart  in  Fig.  III-l. 
The  factors  affecting  the  accuracy  of  the  program  are  shown  by  the 
data  of  Table  III-l.   A  comparison  of  the  accuracy  of  the  program  for 
the  worst  and  best  approximations  over  a  series  of  trial  runs  is  shown 
in  Table  III-l  and  Table  III-3.   Fiye  design  examples  are  provided  at 
the  end  of  the  chapter. 

B.   CAPABILITIES  AND  LIMITATIONS  OF  THE  PROGRAM 

For  the  designs  attempted,  results  indicated  that  the  optimization 
program  is  highly  accurate  and  relatively  fast.   A  comparative  study 
between  the  gradient-projection  method  described  in  the  Naval  Post- 
graduate School  thesis  by  Major  C.  A.  Henry,  and  the  pattern-search 
method  was  conducted  to  determine  the  relative  accuracy  and  speed  of 
the  two  methods.   Examples  2,  4,  and  5(a)  in  Chapter  III  were  selected 
for  the  comparisons.   The  results  are  shown  in  Table  IV- 1.   Very 
accurate  results  can  be  achieved,  as  shown  by  Example  4  in  Chapter 
III.   On  the  other  hand,  results  may  deviate  considerably  from  what 
is  desired,  as  illustrated  in  Example  3  in  Chapter  III.   A  high  degree 
of  accuracy  can  be  achieved  if  the  circuit  configuration  chosen  is  the 
proper  one  for  the  desired  response.   At  present  there  is  no  known 
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optimization  program  that  automatically  alters  the  configuration  of 
the  network  to  yield  an  optimum  solution. 

TABLE  IV- 1 


Design   Problem 

Method 

Function      Execution 
Value          Time (sec) 

Straight-Line 
Approx . 

Gradient    Projection 

1.655                         132 

Pattern   Search 

1.651                           50 

Fifth-Order 
Butterworth 

Gradient    Projection 

0.458xl0"2             133 

Pattern  Search 

0.204xl0"5              49 

Band   Pass 

Gradient   Projection 

0.564xl0"4            328 

Pattern  Search 

0.220xl0-5             184 

One  of  the  main  limitations  of  the  optimization  program  is  that 
an  excessive  execution  time  is  required  for  circuits  with  more  than 
12  or  13  elements.   The  reason  for  this  is  that  CAIAHAN  finds  the  tree 
for  the  network  each  time  the  elements  are  perturbed.   This  is  not 
necessary  since  the  circuit  configuration  remains  the  same  throughout 
the  optimization  process;  however  no  attempt  was  made  to  alter  this. 

The  total  memory  requirements  for  the  program  are  approximately 
110  K  bytes.   This  may  or  may  not  present  a  problem  depending  upon 
the  computer  system  available  to  the  circuit  designer. 

C.   FUTURE  REFINEMENTS 

Possible  areas  in  which  the  program  may  be  improved  or  imple- 
mented are  : 

(1)  Modification  of  the  tree-finding  process  so  that  the 
tree  is  found  only  once  for  each  circuit  configuration. 
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(2)  Use  of  the  program  to  optimize  active  networks. 

(3)  Development  of  a  means  to  "grow"  elements;  i.e.  development 
of  a  technique  that  will  change  the  circuit  configuration.   In  this 
manner  the  circuit  configuration  as  well  as  optimum  element  values 
would  be  calculated. 
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C  A  NETWORK  OPTIMIZATION  PROGRAM 

C 

C 

c 
c 

C      A  COMPINATION  OF  THE  CALAHAN  LINEAR  NETWORK  ANALYSIS 

C      PROGRAM  AND  THE  DIRECT  SEARCH  MINIMIZATION  PROGRAM 

C      FOR  THE  SOLUTION  OF  CIRCUIT  DESIGN  PROBLEMS 

C 

C 

C  MAIN  PROGRAM 

C 

C 

EXTERNAL  FE 

DIMENSION  MP<100,3) ,ML( 5C,5) ,ELT(100) , MAP ( 20 , 5 ) , ELT A 
1(20) ,VAL(100)f VALA(20),C( 50) ,G( 50),H( 50) , VI 1(60) ,Y12 
2(60) ,Y(6C) ,Z(6C) ,Y2 1(60) ,Y22( 60) ,VALL( 50), ZZ (60,2), D 
3( 1CC),P2( 100),PP( 60,2) ,BU(15) ,BL( 15) 
DIMENSION  LABEH20) 

COMMON  VAL ,OMGMI N, OMGM AX , Y , R2 , D , ELT , ELT A , V ALA ,Y 1 1 ,Y 12 , 
IV ALL , Y2 1, Y 22, Z, Z Z, PP, L I N,N0M,JP,JZ,KEY1,ND,NPL,NN, J  I , 
2KI  ,J0»K0,NAL,KEY2,MP,MAP, JW , NVAR , KEY  3 , NR ES 
REAL  IHC  /  4HC    / 

10  CLOCK=ITIME(0>*.01 
READ(5,11,END=26)  LABEL 

11  F0RMAT(2CA4) 
WRITE  (6,12)  LABEL 

12  FORMAT  (1H1,10X,2CA4) 

C       REAP, PRINT  RLC  ELEMENTS 

READ(5,13)NPL,NAL,NN, J  I , K I , JO, KO, ( MP ( J,1),MP( J, 2) ,ELT 
1( J),VAL( J) ,J=1,NPL) 

13  FORMAT (7( I2,1X)/(I2,1X,I2,1X,A1,1X,F10.0)I 
WPITE(6,14) 

1^  FORMAT(//,10X,19HCIRCUIT  INPUT  DATA        ,//) 

WRITE (6, 15 )  NPL,NAL,NN,JI,KI,J0,K0, (  MP  (  J , 1 ) , MP( J  ,  2  )  , 
1ELT( J) ,VAL( J) , J=l ,NPL) 

15  FCPMAT(9X,"M I2,1X)/(9X,I2,1X,I2,1X,A1,1X,F18,9)) 
C      IF  ACTIVE  ELEMENTS, READ  AND  PRINT 

IF(NAL)  16, 19,16 

16  READ  (5,17)  ( (MAP( J, I) , 1  =  1,4) ,ELTA( J)  ,VALA( J)  ,J=1,NAL) 

17  FCRMAT(4(I2,1X),A1,1X,F10.0) 

WRITE(6,lfi)( (MAP( J, I)  ,1=1,4)  ,ELTA( J)  ,VALA( J)  ,J  =  1,NAL) 

18  FORMAT (9X, 4 ( I2,1X),A1,1X,F18.9) 

19  KEY1=1 
KEY2=2 
KEY3=1 
NVAR=0 
NVAL=C 
READ(5,2C)LIN,NOM,OMGMIN,OMGMAX 

20  FORMAT! 1 1 , IX , I 3/2F1 0. 0  ) 

C      ND  INCLUDES  THE  STARTING  POINT 

NC=NCM+1 
C      D(I)  IS  THE  DESIRED  FREQUENCY  RESPONSE 

READ(5,21KD(I  ),I  =  1,ND) 

21  FCRMAT(F15.7) 
JW=1 

C      NRES  IS  THE  NUMBER  OF  CONSTANT  ELEMENTS 
C      NFX  IS  THE  NUMBER  OF  VARIABLE  ELEMENTS 
READ(5,22)  NRES,NEX 

22  FCRMAT(2I5) 
PEAD(5,23)DEL,RH0,DEC,MAXEV 

23  FORMAT(3F15.7,I5) 

C      BU(I)  IS  THE  UPPER  BOUND 
C      BL(I)  IS  THE  LOWER  BOUND 

READ (5, 24) ( BU(  I  )  ,  BL ( I ) , 1= 1, NEX I 

24  FCRMAT(2F15.7) 
NPM=NPL-NRES 

CALL    DIRECT(VAL,NPM,SPSI,DEL,RH0,DEC,FE,K0N,MAXEV,-1, 
1BU,BL) 
KEY1=2 

CALL    FRE0Q(LIN,N0M,0MGMIN,0MGMAX,JP,JZ,Y,ZfKEYl,R2) 
CL0CK=ITIME(0)*.01-CL0CK 
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WRITE(6,25)  CLOCK 

25  FORMATdX, 'EXECUTION  T  IME=.»  ,  F7.  2,  •  SEC.  • ,  /  ) 
GO  TO  10 

26  STOP 
END 

C 

C 

C  SUBROUTINE  DIRECT 

C 

C 

C 

C 

C      TC  LOCATE  A  MINIMUM  OF  A  FUNCTION, S,  OF  K  VARIABLES 

C         BY  THE  METHOD  OF  DIRECT  SEARCH  (HOOKE  AND  JEEVES) 

C 

C 

C 

C       DESCRIPTION  OF  PARAMETERS 

C 

C 

C      PSI  IS  THE  VECTOR  OF  K  INDEPENDENT  VARIABLES.  IT  IS 

C      INITIALLY  FILLED  BY  USER  WITH  FIRST  GUESS  OF  SOLUTION 

C      AT  EXIT  FROM  DIRECT  IT  CONTAINS  BEST  VALUES  ATTAINED. 

C 

C      K  IS  THE  NO.  OF  INDEPENDENT  VARIABLES  OF  THE  FUNCTION, 

C      S,TO  BE  MINIMIZED 

C 

C      SPSI  AT  EXIT  FROM  DIRECT  CONTAINS  SMALLEST  S(PSI) 

C      ATTAINED 

C 

C      DELCAP  IS  THE  INITIAL  STEP  LENGTH 

C      DELCAP  IS  ALTERED  BY  DIRECT.  90  NOT  USE  A  NUMERICAL 

C      VALUE  IN  THE  CALLING  LIST 

C 

C      RHO  IS  THE  STEP  REDUCTION  FACTOR    SUGGESTED  VALUES 

C      ARE  .125  OR  .25 

C 

C      DFLLC  IS  THE  TERMINATION  CRITERION   WHEN  THE  CURRENT 

C      STEP  SIZE  IS  LESS  THAN  DELLC  THE  SEARCH  IS  ENDED. 

C 

C      S  IS  THE  NAME  OF  THE  EXTERNAL  FUNCTI ON, S i PHI ) ,T0  BE 

C      MINIMIZED.   A  FUNCTION  SUBPROGRAM  OF  THE  SAME  NAME 

C      MUST  BE  SUPPLIED  BY  THE  USER 

C 

C      KONVRG  IS  AN  INDICATOR  TESTED  UPON  EXIT  FROM  DIRECT. 

C      K0NVRG=-1,A  PARAMETER  ERROR  WAS  DETECTED. 

C  K.GT.15    OR   K.LE.O, 

C  DELCAP. LE.O, 

C  RHO. LE.O   OR   RHO.GE.l, 

C      KCNVRG=0,MAXEV  WAS  EXCEEDED. MINIMUM  WAS  NOT  FOUND 

C      KCNVPG  GREATER  THAN  ZERO  THEN  THIS  NUMBER  IS  THE 

C      NUMBER  OF  EVALUATIONS  OF  THE  FUNCTION. 

C 

C      MAXEV  IS  THE  MAX.  NO.  OF  EVALUATIONS  USER  ALLOWS 

C      TC  FIND  THE  MINIMUM. 

C 

C      KN  IS  AN  INDICATOR  USED  TO  OBTAIN  OUTPUT 

C      KN=-1  OUTPUT  OF  FUNCTION  VALUE  AND  VARIABLES  IS  MADE 

C      AT  ORIGIN, AFTER  EACH  EXPLOPE  MOVE, AFTER  EACH  PATTERN 

C      MOVE,  AND  AT  EXIT. 

C      KN=0,  MO  OUTPUT  BY  DIRECT 

C      KN=1,SAME  AS  FOR  -1  EXCEPT  EXPLORE  MOVES  ARE  OMMITED. 

C 

SUBROUTINE  DIRECT  ( X, K, SPSI , DELCAP, RHO, DELLC, S, KONVRG, 
1MAXEV,KN,BU,BL) 

CI  MENS  ION  XYZ(50),PSI( 15 ) , PH I < 1 5 ) , SLC < 1 5 ) , X< 15),BU< 15) 
1,BL(15) 

INTEGER  EVAL 

DO  100  1  =  1, K 
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iCO  PSM  I )=X( I  I 


4 

5 
6 

7 

8 

9 
60 


61 
63 


62 

1 

10 


IF(K.GT.15  >  GO  TO  50 
IF(K)  50,50,4 
IF(DELCAP)  50,50,5 
IE(RHO)  50,50,6 
IF (RHO.GE. 1. I  GO  TO  50 
IF(DELLC)  50,50,7 
MAXEVL  =  MAXEV 
IF(MAXEVL)  3,8,9 
MAXEVL  =  500 

DC  60  1=1, K 
SLC(  I)  =  DELCAP 
SPSI  =  S(PSI  ) 
EVAL  =  1 

IF(KN)  61,1.61 

WRITE  (6,63i  DELCAP, RHO,DELLC, MAXEVL, KN,( I  ,1  =  1, K) 

FORMAT  (14H1DIRECT  SEARCH, 2X , 8HDELC AP= , E 1 5. 6, 2X, 5HRH0 
1  =,E15.6,2X,7HDELLC  =  ,  E15.6  ,  2X , 8HMAXEVL  =,I8,2X,5H  KN 
2=,I3//8HC  MOVE   , 1 5H  FUNCTION  V ALUE ,3X, 3X , 12 , 6HST  VAR, 
34X,?X, I2,6HND  VAR,4X,  3X,I2,6HRD  VAR , 4X, 3( 3X,  I  2 , 6HTH 
4  VAR, 4X1/  26X,6(3X, I2,6HTH  VAR , 4X ) /26X ,6 ( 3X , I  2 , 6HTH  VA 
5R,4X)  ) 

WRITE  <  6,62)  SPSI,  ( PS  I  (  II  ,  1  =  1 ,K ) 

FCPMATC8HC0RIGIN  , E 15. 7  ,3X  ,6E15.6  / ( 26X ,6E1 5 . 6 )  ) 

SS  =  SPSI 
DC  10  1=1, K 
PHK  I)=  PS  I  (  I  ) 

ASSIGN  11  TO  IBK 
GO  TO  40 


11  IF(KN)  12,13,13 

12  WRITE  (  6,14)  SS,(PHI( I) ,I=1,K) 
14  FORM AT ( 8HC EXPLORE , E 15.7, 3X,6£15. 6 

13  IF(SS.GE.SPSI»    GO    TO    3 

2  IF     (EVAL. GE. MAXEVL)    GO    TO    51 


/(26X, 6E15.6) ) 


21 

22 
23 


20 


40 


21,50,22 
GT.PSI ( I ) ) 


DO    20    1=1, 

IF(SLC(  I)) 

IF(PHI( I). 

GC    TO    23 

IF(PHI(  D.LT.PSKI  )  ) 

THET    =    PSI (I ) 

PSK  I)    =    PHK  I  ) 

PHK  I)     =    2.*PH1  (I  )    - 

PHI  (  I)=AMIM(PHI  (  I  )  ,BU(  I  )  ) 

PHK  I)  =  AMAX1  (PHK  I  )  ,  BL  (  I )  ) 

CONTINUE 

SPSI    =    SS 

SPHI=S(PHI  ) 

SS=SPHI 

EVAL    =    EVAL    +1 

ASSIGN    25    TO    IBK 

DC    41    1=1, K 

THET    =    PHI  (I  ) 

SLCI    =    SLC(I  ) 

PHK  I)    =    THET    +    SLCI 

PHK  I)=AM1N1(PHI  (I  )  ,BU(  I)  ) 

PHK  I)=AMAX1(PHI(I  )  ,  BL  (  I)  ) 

SPHI    =S(PHK 

EVAL    =    EVAL    +1 

IFCSPHI.LT. SSI    GO    TO    42 

PHK  I)     =    THET    -    SLCI 

PHK  I)  =  AMAX1(PHK  I  ),BL(  I)  ) 

PHK  I)  =  AMINKPHKI  ),BUC  I)  ) 

SPHI=S(PHI  ) 


SLC(I)    =-SLC(I) 
SLCC  I)    =    -SLC(  I  ) 

THET 
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EVAL  =  EVAL  U 

IF(SPHI.GE.SS)  GO  TO  44 

StC(II=-SLCI 
42  SS=SPHl 

GO  TO  41 
44  PHK  I)=THET 
41  CONTINUE 
C 

GO  TO  IBK, (11,25) 
C 

25  IF(KN)  27,28,27 

27  WPITE(  6,2<?)  SS,(PHI( I )  ,I=1,K) 

29  FORMAT(8H  PATTERN, E15. 7, 3X , 6E 15. 6  /( 26X, 6E 15. 6) ) 
C 

28  IF(SS.GE.SPSI)  GO  TO  1 
00  26  1=1, K 
IF(ABS(PHI( II-PSIU )).GT.0.5*ABS(SLC( I) > )  GO  TO  2 

26  CONTINUE 
C 

3  IF(DELCAP.LT.DELLC)  GO  TO  52 
DELCAP  =  RHO  *  OELCAP 
DO  30  1=1, K 

30  SLC( I)  =  RHO  *  SLC( I) 
GO  TO  1 

C 

50  KCNVRG  =  -1 
GO  TO  5  3 

51  KONVRG  =  0 
GO  TO  53 

52  KONVRG  =  EVAL 

53  IF(KN)  55,54,55 

55  WRITE(  6,56)   KONVRG, SPS I , (PSI ( I ) , 1=1 ,K ) 

56  FCRMATt 1CH0K0NVRG=  ,I10/8H  EXIT    , El  5. 7 , 3X ,6E15. 6/ 
1(26X,6E15.6)  ) 

54  RETURN 
END 

C 

C 

C  FUNCTION  FE 

C 

C 

FUNCTION  FE(X) 

DIMENSION  VAL(IOO)  ,  X(  100  )  ,D(  100  ),Y ( 60 ) , Z ( 60) ,R2( 100 ) , 
1MP(10C,3),ML(50,5) ,ELT( 100 >  ,MAP (20 ,5 ) , ELTA(20  ) , VAL A (20 
2),C(50).Y11(60),Y12(60),Y21(60),Y22(60), VALL(50), 
3ZZ(60,2) ,PP(60,2) 

COMMON  VAL,0MGMIN,0MGMAX,Y,R2,D,ELT,ELTA,VALA,Y11,Y12, 
1VALL,Y21,Y22,Z,ZZ,PP,LIN,N0M, JP , JZ, KEY1 , NO, NPL, NN, JI , 
2KI ,J0,K0,NAL,KEY2,MP,MAP,JW,NVAR,KEY3,NRES 

NPM=NPL-NRES 

DO  2  J=1,NPM 
2  VAL(J)=X(J) 

CALL  TOPOL(NPL,NAL,NN,JI,KI,JO,KO,3,KEY2,MP,ELT,VAL, 
1MAP,ELTA,VALA,Y11,Y12,VALL,JW,NVAR,KEY3.  Y,NP,  JU) 

CALL  TOPOL(NPL,NAL,NN, JI,KI , JO,KO,2,KEY2,MP,ELT,VAL, 
1MAP.ELTA,VALA,Y21,Y22, VALL , JW,NVAR , KEY3 , Z ,NZ , J22) 

DO  14  J=l,60 

IF(YU)  >6,4,6 

4  IF(ZU)  )6,8,6 
6  JP=NP-J+1 

JZ=NZ-J+1 

GO  TO  16 
8  DO  10  K=1,NP 
10  Y(K)=Y(K+I) 

DC  12  K=1,NZ 
12  Z(K)=Z(K+1 ) 
14  CONTINUE 
16  CONTINUE 

DO  20  J=l,60 

JJ=JP-J*1 
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IF(Y(JJ) )18,20f 18 
18  JP=JP-J*1 

GO  TO  22 
20  CONTINUE 
22  DO  26  J=l,60 

JJ=JZ-J+1 

IF(Z(JJ) )2A,26,2A 
24  JZ=JZ-J+1 

GO  TO  28 
26    CONTINUE 

CALCULATE    ZEROS 
28    CALL    MULLEMY,  JP,ZZ) 

CALCULATE     POLES 

CALL    MULLER (Z, JZ,PP) 

CALCULATE    FREQUENCY    RESPONSE 

CALL    FREQQ(LINtNOM,OMGMINf OMGMAX, JP,JZfY,ZtKEYl,R2> 

FE  =  0. 

DO    1     1=1 »ND 

FE=FE+(P2(  I )-D(  I)  )**2 

RETURN 

END 
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